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Background 


Traditionally,  DoD  Acquisition  Organizations  have  found  it  difficult 
to  meet  established  OSD  Obligation  and  Expenditure  rate  Goals 


Recent  USD  (Comptroller  and  &  ATL)  Guidance 


Obligation  and  Expenditure  Goals 
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2.  ...obligation  rates  lower  than  established 
benchmarks  should  not  be  the  determinative 
measuring  stick  for  program  execution  and  must  not 
be  regarded  as  a  failure . 

3.  Late  obligation  of  funds  should  not  be  presumed 
to  imply  that  the  funds  are  not  needed  or  that  future 
budgets  should  be  reduced  unless  there  is  other 
evidence  to  support  that  conclusion.  It  may, 
however,  indicate  a  need  to  examine  whether 
rephasing  funding  is  appropriate  to  more  properly 
align  with  actual  program  execution. 

4.  Providing  savings  to  the  organization,  military 
service,  or  DoD  component  as  early  in  the  fiscal  year 
as  possible  should  be  encouraged  and  rewarded, 
professionally  and  visibly. 

5.  Savings  will  not  be  reallocated  at  any  higher  DoD 
level  than  necessary  to  fulfill  shortfalls  in  priority 
requirements. 

6.  Managers  who  release  unobligated  funds  to  higher 
priorities  will  not  automatically  be  penalized  in  their 
next  year's  budget  with  a  lower  allocation  and  may 
be  candidates  for  additional  funding  to  offset  prior 
year  reductions. 
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Survey  Key  Features 


•Customized  branching— more  efficient 
for  respondent  and  data  analysts 

•Used  1-7  Likert  scale 

•Questions  mostly  quantitative 

•Matrix  reduced  respondent  time 

•Non-attribution  promised... 
confidentiality  maintained 

•Some  key  questions  open-ended 
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Open-ended  Questions 


1. How  could  OSD  and  DoD  Components  better  measure  and/or  incentivize 
program  execution  while  promoting  efficiencies  and  acquisition 
effectiveness? 

2.  How  could  PMs  be  incentivized  to  return  excess  or  early-to-need  funds? 

3.  What  metrics  are  useful  to  manage  obligation  of  funds? 

4.  Any  recommendations  to  help  meet  OSD's  obligation  and  expenditure 
goals? 

5.  Any  recommendations  to  PMs/BFMs  to  improve  obligation/expenditure 
rates? 

6.  Any  Requirements  issues? 

7.  Any  Insufficient  personnel  resources? 

8.  Any  Program  plan  issues? 

9.  Any  Program  Management  office  issues? 

10.  Any  Acquisition  Authority  issues? 

11.  Causes  of  uneven  burn  rate? 

12.  Any  Contractual  issues? 

13.  Other  actions  affecting  under  execution? 
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Factors  rated  with  regard  to 
their  respective  programs 


REQUIREMENTS 

10.  Rate  the  level  of  adverse  impact  of  the  following  factors  on  your  program's  ability  to  meet  OSD's  End-of-Year 
Obligation  and  Expenditure  goals.  Also,  if  this  factor  occurs  periodically,  indicate  frequency.  If  not,  select  N/A. 

N/A=Not  Applicable;  DK=Don't  Know;  D=Daily;  W=Weekly;  M=Monthly;  Q=Quarterly;  SA=Semi  Annually;  A=Annually 
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Four  Open-Ended  Questions 


Findings 


1.  What  metrics  have  you  found  most  useful  in  managing  the  obligation  of  funds? 

151  Recommendations:  real-time  monitoring. ...frequent  reviews. ..tight 
coupling  to  contractor  actions  and  milestones... realistic  spend  plans  with  inch 
stones. ..traceability... 

2.  What  other  recommendations  would  you  make  to  meet  OSD's  Obs/Exps  goals? 

123  Recommendations:  include  a  CRA  duration  variable. ..realistic 

plans. ..funding  stability. ..reduce  bureaucratic  obstacles. ..synchronize  processes 

and  accounting  systems... 

3.  What  would  you  recommend  to  PMs/BFMs  to  improve  OBLIGATION  rates? 

149  Recommendations:  Better  Planning  (82).. ..Realistic  schedules(31)... 

4.  What  would  you  recommend  to  PMs/BFMs  to  improve  EXPENDITURE  rates? 

158  recommendations:  realistic  goals. ..streamlined  processes... 
government/industry  cooperation...  accountability...  proactive  workforce... 

9 


Frequency  a ,  =  .70 
x  =  3.36 


Contributing  Factors 
(Frequency  vs  Impact) 


Scatter  Plot  Results  >  x  (for  impact) 


5.0 


4.5 


4.0 


3.5 


3.0 


2.5 


2.0 


3( 

4 

2 

9 

31 

16  11 
13 
19 

6 

8 

24 

21  9 

2 

6 

18 

23  17 

7 

5 

3.5  4.0 


4.5  5.0 

Impact  a  =  .73 
x  =  3.82 


Findings 


1  **Late  release  of  full  obligation/budget  authority  due  to  CRA 

2  **Contract  negotiation  delays 

3  **Contract  award  delays 

4  **Shortage  of  Contracting  Officers 

5  **Congressional  mark 

6  **Contractor  proposal  prep  delays 

7  **OSD  directed  RMD  adjustment 

8  **RFP  prep  delays 

9  **Source  selection  delays 

10  *  Unrealistic/overly  optimistic  spend  plans1 

11  *Changes  in  user  requirements 

12  *  Changes  to  program  acquisition  strategy1 

13  *Changes  in  other  stakeholder  requirements 

14  *  Preparing  DAE  level  review  and  decision1 

15  *  Lack  of  decision  authority  at  expected  levels1 

16  implementation  of  new  OSD/Service  policy 

17  Component  directed  POM  adjustment 

18  *  Awaiting  reprogramming  action 

19  *Changes  in  user  priorities 

20  *  Realistic  spend  plans  but  risks  materialized1 

21  *Program  delays  from  additional  development,  testing  or  other 
prerequisite  events 

22  *  DC  A  A  administrative  actions1 

23  *Unplanned  Congressional  adds  to  PB  request 

24  *Use  of  undefinitized  contract  action  delays 

25  *  Expenditure  contingent  on  hardware  delivery1 

26  *Loss  of  funding  through  reprogramming  action  to  higher  priority 
requirements  to  PEO  portfolio 

27  *Lack  of  Experience  levels  in  key  acquisition  functional  areas1 

28  *  Awaiting  DAE  level  review  and  decision1 

29  *Shortage  of  Cost  Estimators 

30  *Shortage  of  Business/finance  personnel 

31  *Programmatic  conflicts  between  gov't  and  prime  contractor 


**  >  +2o 
**  >  +1  a 

*>  X 

1  Impact  without 
Frequency 
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I  PI  *  Implications  of  DoD  Funds  Execution  Policy 
Investigation  of  Individual  Programs 


Findings 


Obligations  or  Disbursement  Rates  in  the  First  Year  of  the  Availability  of  Funds 


Overall  DOD  Execution  Rates  for  2006  and  2013 


*IDA  Paper  P-5164 


2006 

2013 

Procurement  Obligations 

78% 

72% 

RDT&E  Disbursements 

57% 

47% 

11 


IDA 


Implications  of  DoD  Funds  Execution  Policy 
25  Program  Interviews 


Findings 


Focus:  To  Identify  Root  Causes 

AH-64  Apache  Helicopter 
Aircraft  Energy  Conservation  Program 
Armored  Multi-Purpose  Vehicle 
C-130J  Hercules  Transport  Aircraft 
CH-47F  Chinook  Helicopter 
Combat  Vehicle  Improvement  Program 

Defense  Enterprise  Accounting  and 
Management  System 

EA-18G  Growler  Electronic  Warfare  Aircraft 
Integrated  Aircrew  Ensemble 

Joint  Land  Attack  Cruise  Missile  Defense 
Elevated  Netted  Sensor  System 

Joint  Primary  Aircraft  Training  System 
Joint  Tactical  Radio  System 
KC-46A  Tanker  Aircraft 
M1A2  Abrams  Tank  Mod  Program 


*IDA  Paper  P-51641 


7 


Kathy  Conley 
Staff  Member  and 
Team  Lead 
Institute  for  Defense 
Analyses 


of  Under-Execution  of  Funds 

M2A3/M3A3  Bradley  Fighting  Vehicle  Mod 
Programs 

Multiple  Launcher  Rocket  System 
Improvement  Program 

MQ-4  Triton  Unmanned  Aircraft  System 

MQ-8  Fire  Scout  Vertical  Takeoff  and  Landing 
Tactical  Unmanned  Aerial  Vehicle 

MQ-9  Reaper  Unmanned  Aircraft  System 
Navy  Multiband  Terminals 
Navy  Standard  Integrated  Personnel  System 

Patriot  and  MEADS  (Medium  Extended  Air 
Defense  System) 

Satellite  Communications:  Mobile  User 
Objective  System 

Warfighter  Information  Network -Tactical 
Wheeled  Vehicle  Protection  Kits 


Interviews  Conducted 
18  February  - 10  June  2014 

Kathy  M.  Conley 
James  R.  Dominy 
R.  Royce  Kneece 
Jay  Mandelbaum 
Susan  K.  Whitehead 


IDA 


Implications  of  DoD  Funds  Execution  Policy 


Findings 


Insights  from  IDA  Investigation  of  Individual  Programs 
and  Connections  to  Previous  DAU  Study  Factors  (F) 


•  Contracting  issues  F  9 

-  Personnel  shortages  and  inexperience  F4 

-  Award  protests  F3'9 

—  Peer  reviews  of  contracting  process  documentation  F8'9'21 

-  Negotiation  delays  F  2 

•  Congressional  actions 

-  Additions  and  reductions  to  requested  funding  F7 

-  Continuing  resolutions(CRs)  F1 

-  Sequestration 

•  Management  actions  and  program  events 

-  Changes  to  requirements,  contract  type,  schedule,  responses  to  operational  needs, 
technical  and  testing  problems,  and  slow  contractor  billing  f611'13’19 

-  Policy  choices  f  16 

—  Use  of  execution  benchmarks  F25'20 
—  Withholding  funding  by  Services  under  CRs  F1 

•  Program  office  personnel  shortages  and  experience  levels  f6-  27 

*IDA  Paper  P-5164 
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Impact  a  =  .73 
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Frequency  a  =  .70 
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Contributing  Factors 
(Frequency  Vs  Impact) 


Scatter  Plot  Results  >  x  (for  impact) 
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r 

Findings 


1  *Late  release  of  full  obligation/budget  authority  due  to  CRA 

2  *Contract  negotiation  delays 

3  *Contract  award  delays 

4  *Shortage  of  Contracting  Officers 

5  *Congressional  mark 

6  Contractor  proposal  prep  delays 

7  *OSD  directed  RMD  adjustment 

8  *RFP  prep  delays 

9  *Source  selection  delays 

10  Unrealistic/overly  optimistic  spend  plans1 

11  Changes  in  user  requirements 

12  Changes  to  program  acquisition  strategy1 

13  Changes  in  other  stakeholder  requirements 

14  Preparing  DAE  level  review  and  decision1 

15  Lack  of  decision  authority  at  expected  levels1 

16  Implementation  of  new  OSD/Service  policy 

17  Component  directed  POM  adjustment 

18  Awaiting  reprogramming  action 
Changes  in  user  priorities 

20  Realistic  spend  plans  but  risks  materialized1 

21  Program  delays  from  additional  development,  testing  or  other 
prerequisite  events 

22  DCAA  administrative  actions1 

23  Unplanned  Congressional  adds  to  PB  request 

24  Use  of  undefinitized  contract  action  delays 

25  Expenditure  contingent  on  hardware  delivery1 

2b  Loss  of  funding  through  reprogramming  action  to  higher  priority 
requirements  to  PEO  portfolio 

^7  Lack  of  Experience  levels  in  key  acquisition  functional  areas1 
28  Awaiting  DAE  level  review  and  decision1 
5  29  Shortage  of  Cost  Estimators 

30  Shortage  of  Business/finance  personnel 

31  Programmatic  conflicts  between  gov't  and  prime  contractor 


*  >+2 a 

*  >+l a 

1  Impact  without 
Frequency 

G  ** 
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Factor  Impacts  and 
Associated  Correlations 


Findings 


r 

r  2  * 

STRONGEST  CORRELATION  COEFFICIENTS 

WEAKEST  CORRELATION 

.77 

.74 

59% 

55% 

Slower  Burn  Rate  than  Expected  due  to: 

60  Favorable  CPI  &  41  Unfavorable  SPI 

54  Effect  of  Contract  Type  on  Outlay  Rates  &  53  Deferred  Payments  for  Scheduling 
....Earning  Fees,  Progress  Payments  or  Performance  Based  Payments 

1 :  Late  release  of  full  obligation/budget  authority 
due  to  CRA 

4:  Shortage  of  Contracting  Officers 

5:  Congressional  Mark/Recission 

8:  RFP  prep  delays 

10:  Unrealistic/overly  optimistic  spend  plans 

12:  Changes  to  program  acq  strategy 

16:  Implementation  of  new  OSD/Service  policy 

18:  Awaiting  reprogramming  action 

20:  Realistic  spend  plans  but  risks  materialized 

21:  Program  delays  from  prerequisite  events 

23:  Unplanned  Congressional  adds  to  PB  request 
25:  Expenditure  contingent  on  hardware  delivery 
26:  Funding  Loss:  reprogramming  action  to  higher 
priority  requirements  to  PEO  portfolio 

29:  Shortage  of  Cost  Estimators 

30:  Shortage  of  Business/finance  personnel 

31:  Programmatic  conflicts  between  govt  and 
prime  contractor 

33:  Delays  in  contractor  payment  due  to  late 
invoices 

34:  Unobligated  prior  year  funding  not  adequately 
factored 

39:  Shortage  of  Tech/Eng/Test  personnel 

40:  Shortage  of  Auditors 

44:  Recission 

49:  Shortage  of  Managers 

51 :  Shortage  of  Staff 

55:  Materiel/Systems  Command  Comptroller 
Withhold 

61:  PEO  Withhold 

.84 

.78 

.66 

.63 

.68 

71% 

61% 

44% 

40% 

46% 

Experience  and  Training  and  Tenure: 

27  Key  Acquisition  Experience  Levels  &  48  Inadequate  Training 

27  Key  Acquisition  Experience  Levels  &  46  Tenure  of  PM  and  Other  Key  Positions 

48  Inadequate  Training  &  58  Insufficient  Workplace  Tools/Apps 

1 5:  Lack  of  decision  authority  &  48  Inadequate  T raining 

48  Inadequate  Training  &  46  Tenure  of  PM  and  Other  Key  Positions 

.81 

66% 

Administrative  Actions: 

36  DCMA  &  22  DCAA 

.82 

.66 

.70 

67% 

44% 

49% 

Changes  In  Content: 

1 1  User  Requirements  &  19  User  Priorities 

45  Systems  Specs  &  37  Redirection  of  Contractor  Efforts 

19  User  Priorities  &  13  Stakeholder  requirements 

.68 

46% 

Programming  and  Reprograming: 

59  PEO  Directed  Programming  &  43  SAE/CAE/Component  Directed  Reprogramming 

.82 

67% 

Industry  Issues: 

52  Contractor  Rework  &  63  Production  Line  Issues  &  64  Labor  Disputes 

.73 

'  .68 

53% 

46% 

Funding  Actions: 

38  OSD  Comptroller  Withhold  &  35  Component  Comptroller  Withhold 

17  Component  Directed  POM  Adjustment  &  7  OSD  Directed  RMD  Adjustment 

1  .73 

i  .71 
.69 
.65 

53% 

50% 

48% 

42% 

Contract  Chain: 

6  Contractor  Proposal  Delay  &  2  Contract  Negotiations  Delays 

3  Contract  Award  Delays  &  2  Contract  Negotiations  Delays 

3  Contract  Award  Delays  &  9  Source  selection  delays 

6  Contractor  Proposal  Delay  &  24  Use  of  undefinitized  contract  action  delays 

I  1  *  The  higher  the  %  the  stronger  the  direction  and  strength  of  the  linear  relationship  between  the  variables 

I  |  Factors  ft  1  -  3  >  +2o;  Factors  ft  4-9  >  +lo  Factors  ft  10  -  31  >  x  15 

DAU 


Similar  Recommendations 


IDA 


Institute  Baseline  Funding  Delay  Adjustment,  then 
measure... 

Make  Funds  available  on  a  timely  basis 

Review  the  entire  contracting  action  value  chain 

Ensuring  contracting  support  is  tightly  linked  with  program 
management  for  effective  working  relationships 

Establish  a  recurring  communication  forum  among  key 
stakeholders-eliminate  perception  gaps 

Co-locate  contracting  and  program  management  offices 

Track  requirement  changes  throughout  a  program's  life; 
look  more  strategically  at  effects  on  program  execution 
and  accompanying  Acquisition  Program  Baselines 

Adjustments  in  funding  for  individual  programs  should  be 
made  only  after  a  thorough  investigation  of  the 
implications 

Review  the  program  review  cycle  and  streamline 
wherever  possible 

Streamlining  review  processes— eliminate  unnecessary 
levels  of  review;  enforce  tight  deadlines 

Build  and  maintain  realistic  spend  plans,  measure  against 
them,  account  for  contingencies,  and  make  adjustments 
with  required  frequency  due  to  real  world  realities 

Use  automated  collaboration  processes  and  decision 
support  tools  to  track  obligations  and  disbursements  and 
keep  spending  plans  current 

Validate  key  personnel  shortage  areas  and  recognize  time 
it  takes  to  rebuild  experience  levels.  Nurture  experience 
in  key  functional  areas  with  strong  catalysts  such  as 
disciplined  on-the-job  training,  programs,  mentoring 

Providing  sufficient  personnel  with  the  appropriate 
expertise  to  program  offices  and  contracting  activities,  as 
well  as  to  conduct  required  reviews 

Evaluate  the  real  effects  of  reprogramming  action  or 
realignment  of  future  budget  decisions  before  any 
corrective  action  is  taken 

Identify  excess  funds  early  for  reprogramming  or  POM 
submission— better  aligns  funding  profiles  with  ability  to 
obligate  funds.  Broaden  authority  to  reprogram  funds 
without  prior  congressional  approval 

Conduct  a  wholesale  review  of  the  program  execution 
metrics  currently  in  place  and  determine  their  usefulness 
and  effectiveness.  How  are  metrics  used? 

Conduct  reviews  of  acquisition  programs  by  Military 
Department  comptrollers— permits  acquisition  managers 
to  convey  full  effects  of  reducing  funds  for  under-execution 

Encourage  innovation  and  avoid  "bookkeeping  process" 
as  RAND  Corporation  found  in  a  recent  study  that  could 
be  limiting  improvements  championed  by  PMs 

Automated  program  management  tools— already  in  use  in 
some  program  offices,  appear  to  be  particularly  helpful  in 
achieving  unity  of  effort 

16 


Back-ups 


Connection  Between  Factors  and  BBP  V3.0  Draft  Metrics 


CONTROL  COST  THROUGHOUT  THE  PRODUCT  LIFE  CYCLE 

•  Continue  to  instill  cost  consciousness  of  the  DoD  AT&L  workforce  -  change  the  culture 


METRIC  |  Expansion  of  RFP  development  and  negotiating  experts  available  to  support  DoD-wide 
contracting  actions 

Institute  a  system  to  measure  the  productivity  and  cost  performance  of  acquisition  programs  and 
institutions... 


METRIC  1  Improved  ability  to  measure  the  effectiveness  of  policies  and  processes,  Long-term 
improvements  in  cost,  schedule,  and  technical  performance  of  acquisitions 

Build  stronger  partnerships  with  the  req'ts  community  to  control  costs 


METRIC  1 A  more  affordable  total  force  construct  and  more  flexible  req'ts  processes  enabling  efficient 


and  responsive  Acquisition 

INCENTIVIZE  PRODUCTIVITY  &  INNOVATION  IN  INDUSTRY  AND  GOVERNMENT 

•  Define  value  of  "capability"  in  "best  value"  competitions 

I  METRIC  |  RFPs  can  be  measured  objectively  to  determine  whether  the  value  of  capability  is  being 
objectively  and  clearly  articulated 

•  When  LPTA  is  used,  define  Technically  Acceptable  to  ensure  needed  quality 

METRIC  |  More  competition.  Fewer  protests,  and  Less  revisit  of  contracts 


•  Reduce  backlog  of  DCAA  audits  without  compromising  effectiveness 

I  METRIC  |  Increase  DCAA  achievement  against  inventory  reduction  goals;  Increase  DoD  achievement  of 
improved  contract  closeout  and  de-obligation  of  expired/canceled  funds 

ELIMINATE  UNPRODUCTIVE  PROCESSES  AND  BUREAUCRACY 

•  Reduce  cycle  times  while  ensuring  quality  of  acquisition  processes  and  decision-making 

METRIC  |  Timely  decisions  based  on  original  plan,  Cost  avoidance,  Retention  of  program  schedule 


Re-emphasize  AE,  PEO  and  PM  direct  lines  of  accountability  to  MDA 

METRIC  1  PM,  PEO,  CAE  and  stakeholder  feedback,  improved  DRM/DAB  exchange  on  issues,  and 


reduced  timelines  for  programs 


Institute  for  Defense  Analyses 

4850  Mark  Center  Drive  •  Alexandria,  Virginia  22311-1882 


■  Spend  plans 

o  How  are  pro  gram  ‘ 4  sp  end  plans 5  ?  develop  ed? 
o  How  kept  current? 
o  What  is  the  approval  process? 

■  Execution  benchmarks 

o  What  funds  execution  benchmarks  are  used? 
o  If  different  from  OSD(C)X  why? 
o  How  is  execution  monitored  against  the  benchmarks? 
o  What  is  the  role  of  the  PEO  and  higher  headquarters? 
o  What  action  is  taken  if  it  becomes  apparent  that  benchmarks  will  not  be 
achieved? 

*  Are  excess  funds  identified  for  reallocation?  If  so:  at  what  level?  What  is  the 
process? 

■  Causes  of  funds  under  execution — primary  and  secondary 

o  Delays  in  receipt  of  funds 
o  Contracting  issues 
o  Congressional  actions 
o  Technical  and  testing  issues 

■  Reductions  based  on  under  execution 

o  Have  reductions  been  imposed  on  your  program  because  of  funds  under 
execution? 

o  If  so,  what  was  the  impact? 

o  Were  hinds  re-phased  (i.e.,  restored  in  later  years)?  If  so,  with  what  effect? 

■  Impact  of  Congressional  actions 

o  Continuing  Resolutions 
o  Funding  adds  and  reductions 
o  Sequestration 

o  Re-programming  request  delayed  or  denied 

■  Contracting  process 

o  Soles  our  c  e  c  onir  acts 
o  Peer  reviews 
o  Negotiations 
o  Pricing  and  availability  data 
o  Audit 

o  Undefmitized  contract  actions  (UCAs) 

■  Impact  of  Better  Buying  Power  and  WSARA 

■  Identify  best  practices  and  tools  used  to  manage  the  execution  of  funds 


Related  Study 
Conducted  by 
IDA.. .and 
Questions 


All  Factors  by  Impact  in  Descending  Order 


1  **Late  release  of  full  obligation/budget  authority 

due  to  CRA 

2  **Contract  negotiations  delays 

3  **Contract  award  delays 

4  **Shortage  of  Contracting  Officers 

5  **Congressional  mark/recission 

6  **Contractor  proposal  prep  delays 

7  **OSD  directed  RMD  adjustment 

8  **RFP  prep  delays 

9  **Source  selection  delays 

10  *Unrealistic/overly  optimistic  spend  plans 

11  ^Changes  in  user  requirements 

12  *Changes  to  program  acq  strategy 

13  ^Changes  in  other  stakeholder  requirements 

14  *Preparing  DAE  level  review  and  decision 

15  *Lack  of  decision  authority 

16  ^Implementation  of  new  OSD/Service  policy 

17  ^Component  directed  POM  adjustment 

18  *  Awaiting  reprogramming  action 

19  ^Changes  in  user  priorities 

20  *  Realistic  spend  plans  but  risks  materialized 

21  ““Program  delays  from  prerequisite  events 

22  *DCAA  administrative  actions 

23  ““Unplanned  Congressional  adds  to  PB  request 

24  *Use  of  undefinitized  contract  action  delays 

25  *Expenditure  contingent  on  hardware  delivery 

26  ’“Funding  Loss:  reprogramming  action  to 
higher  priority  requirements  to  PEO  portfolio 

27  *Lack  of  Experience  levels  in  key  acq  func  areas 

28  *  Awaiting  DAE  level  review  and  decision 

29  *Shortage  of  Cost  Estimators 

30  ’“Shortage  of  Business/finance  personnel 

31  ’“Programmatic  conflicts  between  govt 

and  prime  contractor 


32  Preparing  SAE/CAE  level  review  and  decision 

33  Delays  in  contractor  payment  due  to  late  invoices 

34  Unobligated  prior  year  funding  not  adequately  factored 

35  Component  Comptroller  Withhold 

36  DCMA  administrative  actions 

37  Redirection  of  contractor  efforts 

38  OSD  Comptroller  Withhold 

39  Shortage  of  Tech/Eng/Test  personnel 

40  Shortage  of  Auditors 

41  Slower  burn  rate  than  expected  due  to  unfavorable  SPI 

42  Awaiting  SAE/CAE  level  review  and  decision 

43  SAE/CAE/Component  directed  reprogramming 

44  Recission 

45  Changes  in  systems  specs 

46  Tenure  of  PM  and  others  in  key  positions 

47  Holding  award/incentive  fees  in  commitment  for  future 
obligation 

48  Inadequate  training 

49  Shortage  of  Managers 

50  Insufficiently  planned  OCO  funding 

51  Shortage  of  Staff 

52  Contractor  rework 

53  Deferred  payments  for  scheduling  earning  fees,  progress 
payments  or  performance  based  payments 

54  Effect  of  contract  type  on  outlay  rates 

55  Materiel/Systems  Command  Comptroller  Withhold 

56  Awaiting  PEO  level  review  and  decision 

57  Termination  Liability 

58  Insufficient  workplace  tools/apps 

59  PEO  directed  programming 

60  Slower  burn  rate  than  expected  due  to  favorable  CPI 

61  PEO  Withhold 

62  Preparing  PEO  level  review  and  decision 

63  Production  line  issues 

64  Labor  disputes  20 
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